Balancing Load versus Decreasing Communication: Exploring the Tradeoffs

نویسندگان

  • Valerie E. Taylor
  • Bruce K. Holmer
  • Eric J. Schwabe
  • Michelle R. Hribar
چکیده

In this papec we propose a domain decomposit ion scheme that seeks to minimize totalparallel execution time by considering the relative importance of two competing concerns balancing the load and minimizing communication -for a particular application and architecture. A simulated annealing approach is used to optimize an objective function with components that measure both load balance and communication requirements. We develop an analytical model of execution time based upon a finite element code executed on the Intel Paragon. This model is used to compare partitions with varying degrees of load imbalance. Most literature in the area of decomposit ion methods heavily emphasizes load balancing over the minimization of communication. Our results indicate that this restrictive approach to load balancing can be relaxed withoutper$ormance degradation. Further, our results indicate that the degree of relaxation possible is dependent upon the target machine and the application; neither one can be neglected.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Balancing Load versus Decreasing Communication: Parameterizing the Tradeoff

Domain decomposition is an important step for parallel scienti c applications, in particular nite element analyses. A good decomposition will minimize both the time spent on local computation and on interprocessor communication. It is often the case that these two goals cannot be satis ed simultaneously. In this paper, we use analytical and experimental results to illustrate the importance of c...

متن کامل

UTS: An Unbalanced Tree Search Benchmark

This paper presents an unbalanced tree search (UTS) benchmark designed to evaluate the performance and ease of programming for parallel applications requiring dynamic load balancing. We describe algorithms for building a variety of unbalanced search trees to simulate different forms of load imbalance. We created versions of UTS in two parallel languages, OpenMP and Unified Parallel C (UPC), usi...

متن کامل

Branch and Bound Based Load Balancing for Parallel Applications

Many parallel applications are highly dynamic in nature. In some, computation and communication patterns change gradually during the run; in others those characteristics change abruptly. Such dynamic applications require an adaptive load balancing strategy. We are exploring an adaptive approach based on multi-partition object-based decomposition, supported by object migration. For many applicat...

متن کامل

Hierarchical Partitioning and Dynamic Load Balancing for Scientific Computation

Cluster and grid computing has made hierarchical and heterogeneous computing systems increasingly common as target environments for large-scale scientific computation. A cluster may consist of a network of multiprocessors. A grid computation may involve communication across slow interfaces. Modern supercomputers are often large clusters with hierarchical network structures. For maximum efficien...

متن کامل

Locality-sensitive task allocation and load balancing in networked multiagent systems: Talent versus centrality

With the development of large scale multiagent systems, agents are always organized in network structures where each agent interacts only with its immediate neighbors in the network. Coordination among networked agents is a critical issue which mainly includes two aspects: task allocation and load balancing; in traditional approach, the resources of agents are crucial to their abilities to get ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1996